Application No. 10/510,954 

Reply to Office Action of May 30, 2007 

IN THE CLAIMS 

Please amend the claims as follows: 

Claim 1 (currently amended): A remote image display method , charact e rized by th e 
stops of comprising : 

image sensing a panoramic object by a remote image sensing device; 

sending a video signal of a part of said image-sensed panoramic object via an image 
capturing device to an image display means portion at a place different from said remote 
image sensing device; 

playing back and displaying said received video signal by said image display m e ans 
portion as an image of a part of said panoramic object; 

image sensing [[its]] surroundings by a camera-equipped portable terminal at a 
position where [[the]] a display on said image display m e ans portion can be seen, and sending 
[[the]] a surrounding video signal to said image capturing device; 

obtaining variation information about [[the]] surrounding image from said cam e ra 
equipp e d portable terminal by a variation detecting portion in said image capturing device^ 
based on a previous receiv e d surrounding video signal and [[the]] a current receiv e d 
surrounding video signal received from said camera-equipped portable terminal ; 

obtaining from said remote image sensing device a video signal of a part of said 
panoramic object changed corresponding to a change of said surrounding image based on 
said variation information; and 

sending said obtained image video signal to said image display means portion . 

Claim 2 (currently amended): An image capturing device comprising: 
a surrounding image receiving m e ans portion for receiving a surrounding video signal 
from a camera-equipped portable terminal; 
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a variation detecting m e ans portion for detecting, from said received surrounding 
video signal, variation information about a variation of the an image of the current received 
surrounding video signal (hereinafter referred to as tho current imag e ) from the an image of a 
previous surrounding video signal (her e inafter ref e rred to as th e pr e vious imag e ) having been 
previously received by said surrounding image receiving m e ans portion, the image of the 
received surrounding video signal hereinafter being referred to as the current image, the 
image of the previous surrounding video signal hereinafter being referred to as the previous 
image ; 

a capturing signal generating m e ans portion for generating a capturing signal from 
said variation information which is used to obtain the a video signal of a part of a panoramic 
object; 

a signal sending means portion for sending said capturing signal to a remote image 
sensing device that performs image sensing of a panoramic object and outputs a video signal; 
and 

an image relay means portion for receiving said video signal from said remote image 
sensing device and for sending the received video signal to an imag^ display m e ans portion at 
the same position as said camera-equipped portable terminal. 

Claim 3 (currently amended): The device of claim 2, wherein: 
said variation detecting m e ans is a m e ans for d e t e cting portion detects , as said 
variation information, direction information corresponding to the a direction of movement of 
said current image with respect to said previous image or/and zoom information 
corresponding to a change in the a size of the a part of said current image corresponding to a 
part of said previous image; and 
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said capturing signal generating m e ans is a m e ans for g e n e rating portion generates , as 
said capturing signal, an extracting reference pixel position signal obtained by correcting a 
previous extracting reference pixel position signal according to said direction information 
or/and an image zoom in/out signal corresponding to said zoom information. 

Claim 4 (currently amended): The device of claim 2, which further compris e s 
comprising : 

a camera direction storage m e ans portion in which th e r e is stor e d which stores 
identification information of each of plural camera devices provided in said remote image 
sensing device and angularly spaced apart in their a shooting direction of the plural camera 
devices ; and 

wherein: 

said variation detecting m e ans is a m e ans for d e t e cting portion detects , as said 
variation information, direction information corresponding to the a direction of movement of 
said current image with respect to said previous image; and 

said capturing signal generating m e ans is a m e ans which portion determines the 
shooting direction by referring to the identification information stored in said camera 
direction storage means portion based on a previously generated transmitting camera 
identification information signal and said direction information, for generating, as said 
capturing signal, a transmitting camera identification information signal of the camera 
identification information corresponding to said d e t e rmin e d shooting direction determined by 
said capturing signal generating portion . 

Claim 5 (currently amended): The device of claim 2, wherein: 
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said variation detecting m e ans is a m e an s for d e t e cting portion detects , as said 
variation information, direction information corresponding to the a direction of movement of 
said current image with respect to said previous image or/and zoom information 
corresponding to a change in the a size of said current image with respect to said previous 
image; and 

said capturing signal generating m e ans is a m e ans for generating portion generates , as 
said capturing signal, a shooting direction change signal corresponding to said direction 
information or/and zoom change signal corresponding to said zoom information. 

Claim 6 (currently amended): The device of claim 2, wherein: 

said surrounding image receiving means is a means for r e c e iving portion receives the 
surrounding video signal from each of a plurality of camera-equipped portable terminals; and 

said variation detecting moans is a m e ans portion is provided with a previous frame 
memory for storing a surrounding video signal used for detecting the previous variation 
information for each camera-equipped portable terminal having transmitt e d its r e c e iv e d 
surrounding vid e o signal , for detecting variation information corresponding to said each 
camera-equipped portable terminal having transmitted the r e c e iv e d surrounding video signal, 
based on the received surrounding video signal and the surrounding video signal stored in 
said previous frame memory corresponding to said each camera-equipped portable terminal 
having transmitted the surrounding video signal; 

said capturing signal generating m e ans is a m e ans portion is provided with a previous 
signal memory for storing a previously generated capturing signal for said each camera- 
equipped portable terminal having transmitted its receiv e d the surrounding video signal, for 
generating a capturing signal corresponding to said d e t e ct e d each camera-equipped portable 
terminal from the variation information corresponding to said d e t e ct e d each camera-equipped 
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portable terminal and said previously generated capturing signal stored in said previous signal 
memory corresponding to said d e t e ct e d each camera-equipped portable terminal, and for 
updating the corresponding one of capturing signals to signal in said previous signal memory 
with said generated capturing signal; 

said signal sending m e ans is a m e ans for s e nding portion sends said generated 
capturing signal and camera-equipped portable terminal identification information for 
identifying the camera-equipped portable terminal corresponding thereto; and 

said image relay means is a m e ans for s e nding portion sends the its received video 
signal to said image display m e ans portion of the camera-equipped portable terminal 
indicated by the camera-equipped portable terminal identification information received 
together with said video signal. 

Claim 7 (currently amended): An image capturing device comprising: 
a surrounding image receiving m e ans portion for receiving a surrounding vide video 
signal from a cam era- equipped portable terminal; 

a variation detecting means portion for detecting, from said received surrounding 
video signal, variation information about a variation of the an image of the curr e nt received 
surrounding video signal (h e r e inaft e r r e f e rr e d to as th e curr e nt imag e ) from the an image of a 
previous surrounding video signal (hereinaft e r r e ferred to as th e pr e vious imag e ) having been 
previously received by said surrounding image receiving means portion, the image of the 
received surrounding video signal hereinafter being referred to as the current image, the 
image of the previous surrounding video signal hereinafter being referred to as the previous 
image; 
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a capturing signal generating m e ans portion for generating, from said variation 
information and a previously generated capturing signal, a capturing signal that is used to 
obtain a video signal of a part of a panoramic object; 

a remote image receiving m e ans portion for receiving a video signal sent from a 
remote image sensing device having performed image sensing of a panoramic object; 

an image capturing means portion for capturing the video signal of a part of the 
panoramic object from said received video signal based on said capturing signal; and 

an image sending m e ans portion for sending said captured video signal to an image 
display moans portion at the a same position as that of said camera-equipped portable 
terminal. 

Claim 8 (currently amended): The device of claim 7, wherein: 

the video signal received by said remote image receiving m e ans portion is a panorama 
video signal; 

said variation detecting m e ans is a m e ans for d e tecting portion detects , as said 
variation information, direction information corresponding to the a direction of movement of 
said current image with respect to said previous image or/and zoom information 
corresponding to a change in the a size of the a part of said current image corresponding to a 
part of said previous image; 

said capturing signal generating m e ans is a m e ans for gen e rating portion generates , as 
said capturing signal, an extracting reference pixel position signal obtained by correcting a 
previous extracting reference pixel position signal according to said direction information 
or/and an image zoom in/out signal corresponding to said zoom information; and 

said image capturing m e ans is a moans for capturing portion captures , from said 
panorama video signal, one frame of video signal produced by zooming in/out, by said image 
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zoom in/out signal relative to the image of the previously sent captured video signal, a partial 
image of the panorama image of said panorama video signal that is defined by one frame of 
video signal or/and the previously generated extracting reference pixel position signal, or said 
corrected extracting reference pixel position signal with reference to the position on the 
panorama image that is determined by said corrected extracting reference pixel position 
signal. 

Claim 9 (currently amended): The device of claim 7, wherein: 

the video signal received by said remote image receiving m e ans portion is video 

signals from a plurality of camera devices of said remote image sensing device with their 

shooting directions angularly spaced apart; and 

which said image capturing device further comprises: 

a camera direction storage m e ans portion having stored herein identification 
information about said plurality of camera devices and information corresponding to their the 
shooting directions; and 

wh e r e in: 

said variation detecting m e ans is a moans for detecting portion detects , as said 
variation information, direction information corresponding to the a direction of movement of 
said current image with respect to said previous image; 

said capturing signal generating moans is a means which portion determines the a 
shooting direction by referring to the identification information stored in said camera 
direction storage m e ans portion based on a previously generated transmitting camera 
identification information signal and said direction information, for generating, as said 
capturing signal, a transmitting camera identification information signal of the camera 
identification information corresponding to said determined shooting direction; and 
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said image capturing moans is a m e ans for capturing that portion captures one of a 
plurality of video signals which corresponding to said generated transmitting camera 
identification information signal. 

Claim 10 (currently amended): The device of claim 9, wherein: 

said variation detecting moans portion includes a m e ans portion for detecting, as said 
variation information, second direction information corresponding to the direction of 
movement of said current image with respect to said previous image in a direction 
perpendicular to the direction of movement of said detected direction information or/and 
zoom information corresponding to a change in the size of that the part of said current image 
corresponding to a part of said previous image; 

said capturing signal generating means is a m e ans for gen e rating portion generates , as 
said capturing signal, an extracting reference pixel position signal obtained by correcting a 
previous extracting reference pixel position signal according to said second direction 
information or/and an image zoom in/out signal corresponding to said zoom information; and 

said image capturing m e ans is a m e ans for capturing portion captures , from said 
captured video signal, one frame of video signal produced by zooming in/out, by said image 
zoom in/out signal relative to the image of the previously sent captured video signal, a partial 
image of the image of said captured video signal that is defined by one frame of video signal 
or/and the previously generated extracting reference pixel position signal, or said corrected 
extracting reference pixel position signal with reference to the position on the panorama 
image that is determined by said corrected extracting reference pixel position signal. 

Claim 1 1 (currently amended): The device of claim 7, wherein: 
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said surrounding image receiving m e an s i s a means for r e c e iving portion receives a 
surrounding video signal from each of a plurality of camera-equipped portable terminals; 

said variation detecting moans is a m e ans portion is provided with a previous frame 
memory for storing a surrounding video signal used for detecting the previous variation 
information for said each camera-equipped portable terminal having transmitted its r e c e iv e d 
the surrounding video signal, for detecting variation information corresponding to said each 
camera-equipped portable terminal, based on the received surrounding video signal and the 
surrounding video signal stored in said previous frame memory corresponding to said 
camera-equipped portable terminal; 

said capturing signal generating m e ans is a m e ans portion is provided with a previous 
signal memory for storing a previously generated capturing signal for said each camera- 
equipped portable terminal having transmitted its r e c e iv e d the surrounding video signal, for 
generating a capturing signal corresponding to said each detected camera-equipped portable 
terminal from the detected variation information corresponding to said det e ct e d each camera- 
equipped portable terminal and said previously generated capturing signal having been stored 
in said previous signal memory corr e sponding in correspondence to said detect e d each 
camera-equipped portable terminal, and for updating the corresponding to signal in said 
previous signal memory with said generated capturing signal; 

said image capturing m e an i s a m e ans for capturing portion captures a video signal 
signal, for each capturing signal corresponding stored in said previous signal memory in 
correspondence to each camera-equipped portable terminal stor e d in said pr e vious signal 
m e mory ; and 

said image sending m e ans is a m e ans for s e nding portion sends said captured video 
signal for said each camera-equipped portable terminal to an image display m e an s portion at 
the a same position as that of said each camera-equipped portable terminal. 



28 



Application No. 10/510,954 

Reply to Office Action of May 30, 2007 



Claim 12 (currently amended): The device of claim 2 or 7, charact e rized by the 
provision of further comprising : 

a variation hysteresis storage m e ans portion for storing the hysteresis information of 
said variation information; 

a decision means portion for deciding whether the variation information detected by 
said variation detecting moans portion is abnormal or not by referring to the hysteresis 
information stored in said variation hysteresis storage means portion ; and 

moans a portion which, when said decision m e ans portion decides that said variation 
information is abnormal, inhibits the a supply of said detected variation information to said 
capturing signal generating m e ans portion . 

Claim 13 (currently amended): A processing method of an image capturing device, 
charact e rized by comprising : 

a first step of deciding whether an operation (hereinaft e r r e f e rr e d to as camera 
op e ration) command for changing the shooting direction of a camera or/and the a lens field 
angle (zoom amount) is received or not , the operation hereinafter being referred to as camera 
operation, the lens field angle being referred to as a zoom amount ; 

a second step of receiving a surrounding video signal of a surrounding object from a 
camera-equipped portable terminal when it is decided in said first step that said command is 
received; 

a third step of detecting, from the received surrounding video signal, variation 
information indicating a variation of the an image of the surrounding video signal from the an 
image of the previous surrounding video signal; 
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a fourth step of generating a capturing signal for capturing a video signal of a part of a 
panoramic object based on the a previous capturing signal and said variation information , the 
part of a panoramic object hereinafter being referred to as a partial object (which part will 
hereinafter b e ref e rr e d to as a partial obj e ct) ; 

a fifth step of sending said generated capturing signal to a remote image sensing 
device which performs image sensing of said panoramic object; 

a sixth step of receiving a video signal from the remote image sensing device; 

a seventh step of sending said received video signal to an image display means 
portion at the a same position as that of said camera-equipped portable terminal; and 

an eighth step of deciding whether a camera operation stop command is received; 

wherein [[if]] when the operation command is not received in said first third step, 
processing proceeds to said sixth step, and [[if]] when the stop command is not received in 
said eighth step, processing returns to said first step. 

Claim 14 (currently amended): A processing method of an image capturing device, 
charact e riz e d by comprising : 

a first step of deciding whether an operation (h e r e inafter r e f e rr e d to as cam e ra 
op e ration) command for changing the shooting direction of a camera or/and the a lens field 
angle (zoom amount) is received or not , the operation hereinafter being referred to as camera 
operation, the lens field angle being referred to as a zoom amount ; 

a second step of receiving a surrounding video signal of a surrounding object from a 
camera-equipped portable terminal when it is decided in said first step that said command is 
received; 
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a third step of detecting, from the received surrounding video signal, variation 
information indicating a variation of the an image of the surrounding video signal from the an 
image of the previous surrounding video signal; 

a fourth step of generating a capturing signal for capturing a video signal of a part of a 
panoramic object based on the a previous capturing signal and said variation information , the 
part of a panoramic object hereinafter being referred to as a partial object (which part will 
h e r e inaft e r b e r e f e rr e d to as a partial obj e ct) ; 

a fifth step of receiving a video signal from a remote image sensing device; 

a sixth step of capturing a video signal of a part of a panoramic object from said 
received video signal based on said generate capturing signal; 

a seventh step of sending said captured video signal to an image display m e ans 
portion at the a same position as that of said camera-equipped portable terminal; and 

an eighth step of deciding whether a camera operation stop command is received; 

wherein [[if]] when the operation command is not received in said first step, 
processing proceeds to said fifth step, and [[if]] when the stop command is not received in 
said eighth step, processing returns to said first third step. 

Claim 1 5 (canceled) 

Claim 16 (currently amended): An image capturing device comprising: 

a surrounding image signal receiving m e ans portion for receiving a surrounding video 

signal variation information signals from each of a plurality of user camera-equipped portable 

terminals; 

a variation detecting portion, provided with a previous frame memory for storing a 
surrounding video signal, for detecting variation information corresponding to said each 
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camera-equipped portable terminal having transmitted the surrounding video signal, based on 
the received surrounding video signal and the surrounding video signal stored in said 
previous frame memory corresponding to said each camera-equipped portable terminal 
having transmitted the surrounding video signal; 

a capturing signal generating m e ans portion provided with a previous signal memory 
for storing a previously generated capturing s ignals signal for each piece of user terminal 
identification information (her e inafter referr e d to as user terminal identification information) 
identifying the user camera-equipped portable terminal having sent the said variation 
information signal, for generating, from the r e c e iv e d detected variation information signal 
and the previously g e nerat e generated capturing signal of the user terminal identification 
information stored in the previously memory, a capturing signal to be used for capturing a 
video signal of a part of a panoramic object , the part of the panoramic object hereinafter 
being referred to as a partial object (which part will hereinaft e r be referred to as a partial 
obj e ct) ; 

a signal sending m e ans portion for sending said generated capturing signal and the 
corresponding user terminal identification information to a remote image sensing device 
which performs image sensing of the panoramic object and outputs its video signal; and 

an image relay means portion for receiving the video signal and the corresponding 
user terminal identification information from said remote image sensing device and sending 
the video signal to an image display mean s portion of the user camera-equipped portable 
terminal corresponding to the user terminal identification information. 

Claim 17 (currently amended): The device of claim 16, wherein: 



32 



Application No. 1 0/5 1 0,954 

Reply to Office Action of May 30, 2007 

said variation information signal is-a represents direction information signal or/and 
[[a]] zoom information signal of the partial object desired to switch from [[the]] a previous 
partial object; and 

said capturing signal generating m e ans portion generates is a means for generating , as 
said capturing signal, an extracting reference pixel position signal obtained by correcting a 
previous extracting reference pixel position signal according to said direction information 
or/and an image zoom in/out signal corresponding to said zoom information. 

Claim 18 (currently amended): The device of claim 16, which further compris e s 
comprising : 

a camera direction storage means in which ther e i s stor e d portion which stores 
identification information of each of plural camera devices provided in said remote image 
sensing device and angularly spaced apart in their shooting direction; and 

wherein: 

said variation information signal is-a represents first direction information signal of 
the partial object desired to change from the previous partial object in a first direction, and/or 
[[a]] second direction information signal of the partial object desired to change from the 
previous partial object in a second direction perpendicular to the first direction information 
signal or/and a and zoom signal information of the desired partial object; and 

said capturing signal generating moans is a means which portion determines the 
shooting direction by referring to the identification information stored in said camera 
direction storage means portion based on a previously generated transmitting camera 
identification information signal and said first direction information, for generating, as said 
capturing signal, a transmitting camera identification information signal of the camera 
identification information corresponding to said determined shooting direction, and/or a 
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reference pixel position signal obtained by correcting said generated reference pixel position 
corresponding to said second direction information signal or/and an image zoom in/out signal 
corresponding to said zoom information signal . 

Claim 19 (currently amended): An image capturing device comprising: 

a surrounding image signal receiving m e ans portion for receiving a surrounding video 
signal variation information signal s from each of a plurality of user terminals; 

a variation detecting portion, provided with a previous frame memory for storing a 
surrounding video signal, for detecting variation information corresponding to said each 
camera-equipped portable terminal having transmitted the surrounding video signal, based on 
the received surrounding video signal and the surrounding video signal stored in said 
previous frame memory corresponding to said each camera-equipped portable terminal 
having transmitted the surrounding video signal; 

a capturing signal generating moans portion provided with a previous signal memory 
for storing previously generated capturing signals for each piece of user terminal 
identification information (h e reinaft e r r e f e rr e d to as us e r t e rminal identification information ) 
identifying the user terminal having sent the said variation information signal, for generating, 
from the received variation information signal and the previously generate capturing signal of 
the user terminal identification information stored in the previously memory, a capturing 
signal to be used for capturing a video signal of a part of a panoramic object , the part of the 
panoramic object hereinafter being referred to as a partial object (which part will h e r e inaft e r 
b e r e f e rr e d to as a partial obj e ct) ; 

a signal sending m e ans portion for sending said generated capturing signal and th e 
corr e sponding user t e rminal id e ntification information to a remote image sensing device 
which performs image sensing of the panoramic object and outputs its video signal; 
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a remote image m e ans portion for receiving the video signal sent from the remote 
image sensing device having performed image sensing of a panoramic object; 

an image capturing m e ans portion for capturing the video signal of a part of the 
panoramic object from said received video signal based on the capturing signal for each user 
terminal identification information stored in said previous signal memory; and 

an image sending m e ans portion for sending said captured video signal to the user 
terminal corresponding to the ef4h user terminal identification information. 

Claim 20 (currently amended): The device of claim 19, wherein: 
the video signal received by said remote image receiving m e ans portion is a panorama 
video signal; 

said variation information signal is-a represents direction information signal or/and 
[[a]] zoom information signal for the partial object desired to switch from the previous partial 
object; 

said capturing signal generating m e ans is a means for generating portion generates , as 
said capturing signal, an extracting reference pixel position signal obtained by correcting a 
previous extracting reference pixel position signal according to said direction information 
or/and an image zoom in/out signal corresponding to said zoom information; and 

said image capturing means is a means for capturing portion captures , from said 
panorama video signal, one frame of video signal produced by zooming in/out, by said image 
zoom in/out signal relative to the image of the previously sent captured video signal, a partial 
image of the panorama image of said panorama video signal that is defined by one frame of 
video signal or/and the previously generated extracting reference pixel position signal, or said 
corrected extracting reference pixel position signal with reference to the position on the 
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panorama image that is determined by said corrected extracting reference pixel position 
signal. 

Claim 21 (currently amended): The device of clam in claim 19, wherein: 

the video signal received by said remote image receiving m e ans portion is video 

signals from a plurality of camera devices of said remote image sensing device with their 

shooting directions angularly spaced apart; and 
which the device further comprises: 

a camera direction storage m e ans portion having stored herein identification 
information about said plurality of camera devices and information corresponding to their 
shooting directions; 

wherein: 

said variation information signal is-a represents first direction information signal of 
the partial object desired to change from the previous partial object or/and a second direction 
information signal of the desired partial object in a direction perpendicular to that of the first 
direction information signal or/and [[a]] zoom signal information of the desired partial object; 

said capturing signal generating m e ans is a means which portion determines the 
shooting direction by referring to the identification information stored in said camera 
direction storage means based on a previously generated transmitting camera identification 
information signal and said first direction information, for generating, as said capturing 
signal, a transmitting camera identification information signal of the camera identification 
information corresponding to said determined shooting direction, and/or a reference pixel 
position signal obtained by correcting said generated reference pixel position corresponding 
to said second direction information signal or/and an image zoom in/out signal corresponding 
to said zoom information signal ; and 
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said image capturing m e ans is a m e ans for capturing portion captures that one of a 
plurality of video signals which corresponds to said generated camera identification signal, 
and for capturing, from said captured video signal, one frame of video signal produced by 
zooming in/out, by said image zoom in/out signal relative to the image of the previously sent 
captured video signal, a partial image of the image of said captured video signal that is 
defined by one frame of video signal or/and the previously generated extracting reference 
pixel position signal, or said corrected extracting reference pixel position signal with 
reference to the position on the panorama image that is determined by said corrected 
extracting reference pixel position signal. 

Claim 22 (currently amended): A computer readable recording medium embedded 
with a program for functioning a computer as said image capturing device described in any 
one of claims 2 to 12 and 16 to 21 2, 7, 16 and 19 . 
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